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; , , Abstract. We consider a non-autonomous ordinary differential equation on 

J^ ■ a smooth manifold, with right hand side that randomly switches between the 

elements of a finite family of smooth vector fields. For the resulting random 
dynamical system, we show that Hormander type hypoellipticity conditions 
v^ , are suflicient for uniqueness and absolute continuity of an invariant measure. 
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1. Introduction 



q 

r^ ' In this paper we study the ergodic theory of systems with random switchings, 

"t^ . Such a system can be described in terms of a finite family of vector fields. We 

assume that at any given time the evolution is driven by one of these vector fields, 
and at random times the driving vector field changes to another one from the same 
family. Systems of this nature arise naturally in applications and we refer to the 
recent monograph jYZlOj for motivation and extensive bibliography. 
J|T ' Many long-term asymptotic properties of dynamical systems or random dynam- 

_j. . ical systems can be described in terms of invariant distributions. The existence of 

[~-«« ' invariant measures often can be derived using the Lyapunov function technique that 

lO ■ helps to establish recurrence properties or tightness, see, e.g.. jYZ10l Sections 3.3- 

Cn: 3.4]- 

f^ , The uniqueness and absolute continuity of invariant distributions are often re- 

CN ' lated to each other and more subtle, especially in the case that we consider in this 

paper where no diffusion is involved, and the only source of randomness is the ran- 
dom sequence of driving vector fields. Although some claims have been scattered 
through the literature, no general result is known, see, e.g., |YZ101 Section 8.5.2]. 
The goal of this paper is to close this gap and obtain new general conditions that 
C^ , guarantee uniqueness and absolute continuity of invariant measures for systems with 

random switchings. The two conditions that we suggest are formulated in terms 
of Lie algebras associated to the driving vector fields. They are close analogues 
of the classical Hormander condition guaranteeing absolute continuity of transition 
densities of hypoelliptic diffusions. In the diffusion context, this result is usually 
derived from the variational analysis of diffusion paths known as Malliavin calculus, 
see, e.g., |Bas98l Chapter VIII] . [Bel06] . |Nua06j . 

In fact, the central part of this paper is the analysis of transition probabilities 
of switched systems. Under the first of our conditions, we prove that all transition 
probabilities for the system have nontrivial absolutely continuous components. The 
second condition is more general, and it allows to prove the existence of absolutely 
continuous components not for the transition probabilities themselves, but for their 
time averages. The extraction of these absolutely continuous components is largely 
based on classical control theory results that can be found in Chapter 3 of |Jur97) . 
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These control theory results rely on earlier work by Chow |Cho39| . Sussmann and 
Jurdjevic [SJ72| , and Krener |Kre74| . Our conditions and the structure of our proofs 
match those of [Jur97j . where the nondegeneracy of certain maps is exploited to 
establish the accessibility property. We use the same nondegeneracy to prove ab- 
solute continuity, and one can interpret our result as filling the control theory with 
probabilistic content. In fact, the idea to use the geometric control theory approach 
to establish regularity of Markov transition kernels along with ergodic properties 
is not new, see, e.g., |AKSS07] where controllability of the 2D Navier-Stokes sys- 
tem was used to prove the absolute continuity of finite-dimensional projections of 
transition kernels. 

The article is organized as follows: In Section [2] we introduce the setting, neces- 
sary notation and notions from differential geometry and geometric control theory. 
We also state the main result on uniqueness and absolute continuity of invariant 
measures, and two central auxiliary results on regularity of transition probabilities 
each based on one of the Hormander type assumptions. We prove these regularity 
results in Sections |3] and S) In Section [5] we prove that any ergodic measure has to 
be absolutely continuous if its support contains a point where hypoellipticity holds. 
Section [6] contains the proof of the main result: if the hypoellipticity holds at a 
point that can be approached from any initial point using the given vector fields as 
admissible controls, then there exists at most one invariant distribution, and this 
distribution has to be absolutely continuous. In Section[71 we apply the main result 
to a switching system on the n-dimenisonal torus and a switching system involving 
two Lorenz vector fields. 

Acknowledgments: The idea to study invariant densities for systems with 
switchings emerged after a discussion of "blinking systems" with Leonid Buni- 
movich and Igor Belykh, and we would like to thank them. We are also thankful to 
L.Bunimovich for his comments on the Lorenz system. We are grateful to Martin 
Hairer and especially Jonathan Mattingly for stimulating discussions of other pos- 
sible approaches to the main results of this paper. The partial support from NSF 
through a CAREER Award DMS-0742424 is gratefully acknowledged by YB. 

2. Definitions, Notation, and Main Results 

2.1. The dynamics. We consider a finite collection D of smooth and forward 
complete vector fields on an n-dimensional C°°-manifold M. 

We denote these vector fields hy Ui, i £ S = {1, ..., k} . Each vector field u in D 
induces an ordinary differential equation of the form 

x{t) =u{x{t)). 

This differential equation is uniquely solvable if equipped with an initial condition 

x{0) ^^£M, 

and forward completeness means that the solution trajectories are well-defined for 
all times i > 0. 

We can define a stochastic process X = {Xt)t>Q on M in the following way: Given 
an initial state i G S and an initial value ^ G M, Xt follows the trajectory generated 
by the vector field u, and initial condition ^ for an exponentially distributed random 
time with parameter A^ > 0. Then a new state is selected at random from S \ 
{i}, and, for another exponentially distributed random time, Xt follows the new 
vector field corresponding to that state. Iterating this construction we obtain a 
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piecewise smooth trajectory {Xt)t>o defined for all positive times and driven by 
one of the vector fields from D between any two switchings. We assume that (i) all 
the inter-switching times are exponentially distributed and independent conditioned 
on the sequence of driving vector fields, (ii) the parameter Xj of the exponential 
time between any two switches depends only on the current state j, and (iii) the 
probabilities of switchings between any two states are positive. 

It is convenient to keep track of the driving vector fields at all times. We define 
At G 5* as the index of the driving vector field at time t, also referred to as the 
regime or state at time t. It is a Markov process with continuous time and finitely 
many states. Its trajectories are right-continuous and piecewise constant. 

Although X alone is not a Markov process, the joint process {X, A) is Markov. 
We denote elements of the associated Markov family, i.e., the distribution on paths 
emitted at {^,i) G M x S and generated by the iterative random procedure above, 
by P^.i, and the corresponding transition probability measures by Pf j, t > 0. The 
transition probability measures are defined on the product cr-algebra B(M)(E)'P(S), 
where B{M) is the Borel cr-algebra on M and P{S) is the power set of S. We write 
E^.i for expectation with respect to P^^^. 

Let us recall that if the initial distribution of the Markov process {X, A) is /x, 
then the distribution of the process at time t is given by the measure /iP* on M x 5* 
defined by 

k 

(1) ^,P\E X {j}) = J2 I PlJE X {j}) ^{dC X {^}). 

A probability measure fi on M x S is called invariant for (P*) if /i = /xP* for all 
i>0. 

The main goal of this paper is to give conditions on D that would guarantee ab- 
solute continuity and uniqueness of an invariant measure of the Markov semigroup 
(P*) = (P*)t>o. The fairly general conditions that we suggest are formulated in 
geometric terms, and we proceed to introduce the necessary definitions and nota- 
tion. 

2.2. Auxiliary definitions and notation. Let V{M) denote the set of real 
smooth vector fields on the manifold M, and let C°°{M) denote the set of real- 
valued smooth functions on M . As explained above, we assume that D is contained 
in V{M). Any element of V{M) corresponds uniquely to a derivation on C°°{M), 
that is to a linear operator 6 on C°°{M) satisfying the Leibniz rule 

Sif-9) = Sif)-g + f-Sig). 

The Lie bracket of two vector fields u and v in V{M) is defined as the vector field 

[u,v]if):^uivif))-viuif)) 

for test functions / in C°°{M). The set V{M) equipped with the bilinear operator 
[., .] becomes a Lie algebra over the reals. A subset of V{M) is called involutive if 
it is closed under taking the Lie bracket. An involutive subspace of V{M) is called 
a subalgebra of V{M). 

The smallest subalgebra of V{M) that contains D is denoted I{D). The derived 
algebra I'{D) is the smallest algebra containing Lie brackets of vector fields in 
I{D). We have I'{D) C I{D), but I'{D) might not contain any elements of D and 
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may therefore be strictly contained in X{D). Further, we define Iq{D) as the set of 
vector fields of the form 

k 



V ■ 

1=1 

^k 



where v € I'{D), ui, . . . ,Uk € D and J2i=i '^i ~ 0- Finally, we set 

X(i?)(0 := MO : ueI{D)} 
and 

MDm ■■= {u{0 ■■ ueMD)} 

for any ^ G M. The sets T{D){£^) and Io{D){£^) are finite-dimensional vector spaces. 

Our main results will be based on the following assumptions that can naturally 
be called hypoellipticity conditions in analogy with Hormander's theory. We say 
that a point ^ £ M satisfies Condition A if dimIo(-D)(0 = "■■ We say that a point 
^ S M satisfies Condition B if dim 1(D) (^ = n. 

The set of points satisfying Condition A is open and so is the set of points 
satisfying Condition B. 

For our absolute continuity results we will need a reference measure on M that 
will play the role of Lebesgue measure. As a smooth manifold, M can be endowed 
with a Riemannian metric. The metric tensor can be used to define measures on 
coordinate patches of M. One can use then a partition of unity in a standard way 
(see, e.g., |Tay06[ Section 7]) to construct a Borel measure on M whose pushforward 
to M" under any chart map is equivalent to Lebesgue measure. We call the measure 
on M obtained through this construction Lebesgue measure, denote it by A-*^, and 
use it as the main reference measure, often omitting "with respect to Lebesgue 
measure" when writing about absolute continuity. The product of the Lebesgue 
measure on M and counting measure on S will be called the Lebesgue measure on 
M X S. We denote the Lebesgue measure on R™ by A™. 

It remains to introduce the fiows generated by vector fields in D and the concept 
of reachability. 

For i € S, we denote the fiow function of the vector field Ui by $i. Due to 
forward completeness of Ui, the flow function is uniquely defined for all i > and 

1] e M hy 

— $,(t,?7) =ii,($,(t,?7)), 
$,(0,77) = 77. 

For TTi G N, we will consider vectors t = (ii, . . . ,t„i) of waiting times between 
subsequent switches and vectors i = (ii,...,im) of driving states during these 
waiting intervals. We will restrict ourselves to positive waiting times, but it can 
also be useful (see JSJ72) and |Jur97j ) to admit fiows backwards in time. 

We write R+ to denote the positive real line (0; 00). 

For t = {ti,...,tm) GR!P andi = (ii,...,i„) G S"", we define 

$i(t,0 :=$,„(i™, $.,„_, (t„_i,...$,,(ti,0)...) 
as the cumulative fiow along the trajectories of Ui^ , . . . , Ui^ with starting point 

Cgm. 



INVARIANT DENSITIES FOR DYNAMICAL SYSTEMS WITH RANDOM SWITCHING 5 

The transition probabilities Pi ^ can be expressed in terms of cumulative flows. 
We do not specify these straightforward relations in order to avoid heavy notation. 

A point 1] £ M is called Z3-reachable from a point £_ E M if there exist a time 
vector t with positive components and a vector i of driving states such that 

If the components of t sum up to i, we say that 77 is I?-reachable from ^ at time t. 
For ^ £ M and i > 0, let Lt{^) denote the set of D-reachable points from ^ at 
time i, and let L(^) — IJ^^q -^t(0 denote the set of £)-reachable points from ^. The 
points in the closure L{S) can be called ZJ-approachable from ^. Let L — Plf eA/ ^iO 
denote the set of points that are Z?-approachable from all other points. 

2.3. Main results. The following is the main theorem of this paper. 

Theorem 1. Suppose Hypoellipticity Condition B is satisfied at some ^ G L. // 
(P*) has an invariant measure, then it is unique and absolutely continuous with 
respect to the Lebesgue measure on AI x S. 

Remark 1. Of course, Theorem[T]remains true if we replace L by any of its subsets. 
For example, if one of the vector fields in D has a minimal global attractor, then it 
is sufficient to check hypoellipticity for some point of the attractor. 

Uniqueness of invariant distributions is tightly connected to the regularity of the 
Markov semigroup. Various aspects of regularity in connection with ergodicity have 
been studied in the literature: the existence of minorizing kernels, the strong Feller 
property, etc. The main task in the proof of Theorem [1] is to establish regularity 
for transition probabilities under Hypoellipticity Condition B. However, we begin 
with a much stronger regularity property that can be established under the stronger 
Hypoellipticity Condition A. 

Theorem 2. // Condition A is satisfied at a point ^ G M , then for any i E S and 
any t > 0, the transition kernel Pi j has a nonzero absolutely continuous component 
with respect to Lebesgue measure on M x 5". 

Under the weaker Condition B it may happen that none of the transition prob- 
ability measures Pi ^, t > 0, has a nonzero absolutely continuous component. For 
example, let M be the n-dimensional torus T" = R^/Z", and let D — {ui, . . . , w„} 
be the standard basis in R". Fix an arbitrary time t > 0. The set of points 
D-reachable from the origin at time t is the image of 

n 

(si,...,s„) € [0;oo)" : ^Sj=t 

i=i 

under the covering map M" -^ T", and has Lebesgue measure zero, so P^ ^ is a 
purely singular measure. 

Nevertheless, Condition B guarantees that time averages of transition probabil- 
ities have nontrivial absolutely continuous components. Specifically, we will estab- 
lish this for the resolvent probability kernel Q^^^ defined by 

(2) QUE X {j}) := / e-* P\AE x {j})dt. 

The resolvent kernels are useful in the study of invariant distributions due to the 
following straightforward result. 
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Lemma 1. // a measure fi is (P^) -invariant it is also (Q) -invariant, i.e., ji — /jQ, 
where the convolution /iQ is defined analogously to ([T]). 

Theorem 3. // Condition B is satisfied at some point ^ e M , then for any i ^ S , 
the measure Q^.; defined by ([2]) has a nonzero absolutely continuous component with 
respect to Lehesgue measure on M x S. 

Although the convergence of transition probabihties to the invariant measures is 
out of the scope of the present paper and will be addressed elsewhere, our analysis 
suggests that under the assumptions of Theorem [T] and Condition A at ^ this 
convergence holds true while Condition B at ^ implies only Cesaro convergence. 

At the heart of our proofs of Theorems[2]and[3]are classical results from geometric 
control theory that can be found in |Jur97j . The statements we present are derived 
from Theorems 3.1, 3.2, and 3.3 in [Jur97j . Analogous results for the special case 
of analytic vector fields on a real analytic manifold are first stated in |SJ721 The- 
orems 3.1 and 3.2]. In their paper, Sussmann and Jurdjevic were able to build on 
prior work [Cho39| by Chow who considered symmetric families of analytic vector 
fields. Krener generalized these results to C°°-vector fields in [ Kre74| . 

Recall that a regular point of a function / : M'" — > Af is a point t G M™ such 
that the differential Df{t) has full rank. If Df{t) has deficient rank, t is called a 
critical point of /. 

Theorem 4. Assume that Condition A holds at some ^ G M . Then: 

(1) For any i,j e S, there are an integer m > n and a vector i G 5"'"+^ with 
ii = i and im+i — j such that for any t > the mapping fi : M™ — > M 
defined by 

y m 

(3) /i(ti,...,i^) = $iUi,...,i„,t-^ij,e^ 

^ 1=1 

has a nonempty open set of regular points in the simplex 

f ni 

At,™ := i(fi,...,i„) elRIf* : ^ti<t 
^ 1=1 

(2) The interior of L{^) is nonempty and dense in L{^). 

Theorem 5. Assume that Condition B holds at some ^ G Af . Then: 

(1) For any i,j G 5*, there are an integer m > n and a vector i G 5"™^^ with 
ii — i and im+i ~ j such that for any t > the mapping Fi : M" — > M 
defined by 

Fi{ti, . . . , tm+l) — ^i{tl, ■ ■ ■ , tm+l,£,) 

has a nonempty open set of regular points in At^m+i- 

(2) The interior of L(^) is nonempty and dense in L(S,). 

Condition A is stronger than Condition B, so it is not surprising that the con- 
clusion of Theorem 3] implies the conclusion of Theorem [5] 

The first statement of Theorem [5] corresponds to Theorem 3.1 in [Jur97| . which 
reads as follows: Under the assumptions of Theorem [5l any neighborhood C/ of ^ 
contains points that are normally accessible from ^ at arbitrarily small times. A 
point rj in M IS called normally accessible from ^ at time t > if there exist vectors 
i G 5""+^ and (ti, . . . , tm+i) G /S.t^m+i such that F\(ti, . . . ,im+i) = V and the 
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differential DFi{ti, . . . ,trn+i) has full rank. It's worth pointing out, though, that 
in |Jur97| only one sequence i resulting in F with a regular point is constructed. 
But since the flow generated by any vector field is a family of diffeoniorphisms, and 
since the set of points satisying Condition B is open, one can append any indices 
in front or at the back of that sequence without destroying the desired properties, 
and thus recover this part of Theorem [5] as we state it. 

The fact that the interior of L(^) is nonempty and dense in L{^) follows from 
Theorem 3.2.a in |Jur97| . 

Theorem [H essentially follows from applying Theorem 3.1 f [Jur97| ) to M x M 
and vector fields 1(B Ui,i £ S, where 

(l©«)(r,e):=(l,u(0), (r,e)eMxA/, 

and 1 is the unit vector field on M corresponding to the derivation d/dr and iden- 
tically equal to 1 in the natural coordinates on M. 

3. Proof of Theorem [2] 
We need to prove that for any t > and i £ S, the measure Pt j is not singular. 

For any finite sequence i of indices in S with initial index i (we will call these 
sequences admissible), let Ci be the event that the driving vector fields up to time 
t appear in the order determined by i. Since Pj_i(Ci) > for any admissible i it 
suffices to find an admissible sequence i such that Pi i{-\Ci) is not singular. We 
claim that this holds true for the the sequence i provided by Theorem^ According 
to TheoremUl there is an admissible sequence i = (ii, ^2, . . . , im+i) with ii — i such 
that the function fi has a regular point in Aj^m. Since the set of regular points 
of a differentiable function is open in its domain, the function fi is regular in a 
nonempty open set B C At.m- 

Let Ti,T2, ■ ■ . , Tm+i be independent and exponentially distributed random vari- 
ables such that Tj has parameter Ai- for 1 < j < m -I- 1. 

On d we have At — im+i, and the distribution of Xt under P{,i(-|Ci) coincides 
with the distribution of /i(Ti, . . . , Tm) conditioned on the event 



(4) R^i,y^T,<t<\T, 









The distribution of the random vector (Ti, . . . , r,„) conditioned on i?, is equivalent 
to the uniform distribution on the simplex 



At^m :— < (tl, . . . ,im) G 






Now the theorem directly follows from the following result: 

Lemma 2. Let n,m £ N, n < m. Suppose that B and A are nonempty open 
sets in R™, B is dense in A, and M is an n-dimensional smooth manifold. If 
f : A ^ M is differentiable on A and all points in B are regular for f , then 
for any absolutely continuous probability measure ^ on A satisfying IJ,{B) > 0, its 
pushforward iJ.f~^ is not singular with respect to A*^. 

We will prove this lemma only for M = K" . Modifying the proof for the general 
case using coordinate patches on M amounts only to notational differences. 
We will use the following statement (see, e.g.. Proposition 4.4 in [DLS98J ): 
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Lemma 3. Let f : B ^>- M™ he a Borel function a. e.- differ entiable on an open 
set B C R™ and satisfying A"{t e B : dctDf{t) = 0} = 0. // /i < A", then 
tJ-r^ <- A"\ and 



ditif-') 



(s)^ E Ideti?/(t)|-i;^(t) 



dA™ ' ' ^^ ' ' " dA" 

tGS:/(t)=s 

Proof of Lemma [2J We must prove that for any E C M" with A"(£') = 0, 

(5) fi{teA: /(t) eE}<l. 

For any t G B, we can find some n columns of Df{t) (without loss of generality, 
first n columns) that are linearly independent. For p : B ^ K" x R™^" defined by 

p : t = (ti,...,i„i) h^ (/(t),i„+i,...,i,„), 

and any t e 5, we have 

deti:>p(t) ^0. 

Since E x R'"^" is a set of measure zero, Lemma [3] implies that 

= A™{t e B : p{t) eEx M™-"} = A™{t e B : /(t) e ^}. 
Therefore, p{t e B : /(t) e ^} = 0, and 

Ai{t e A ; /(t) e £;} = M{t e A \ B : /(t) eE}<i- n{B) < 1. 

so dSI is established and the proof is complete. D 

4. Proof of Theorem [3] 

We need to show that Q^.i is not a singular measure. The proof is based on 
Theorem [5j 

For the 5- valued process A we denote by It (A) the sequence of states visited by 
A between and t. For any to G N and any sequence i G 5'™, we can introduce an 
auxiliary measure Qj.ij on M by 



Q? 



^,i{B) = f e-* P^A^t e B and It{A) = i} di, B G B(M). 



Since 

(6) Q^4Bx{j})=Yl E Q«.m(S)> 

"1 i=(i,i2,---,im-i,i)es™ 

it is sufficient to find i = (ii, . . . , i™) with ii = i such that Q^.ij(M) > and 

^^'''^ ' Q«,u(M) 

is a nonsingular probability measure. To apply Lemma [21 we need to represent 
Q^ i i as the pushforward of a measure, equivalent to Lebesgue measure, under a 
smooth map with a nonempty set of regular points. 

Since Condition B holds at ^, Theorem [5] yields an integer m > n and a sequence 
i = (ii, ^2, . ■ . , im+i) with ii = i, such that the function Fi : M.^~^^ -^ M defined by 

Fi(t) = $i(t,0 
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has a regular point. For this i provided by Theorem [5l Q^^i.i is the distribution of 
^i(Ti,...,T^,T-J2]Li Tj , e) conditioned on 

(7) R=\Y,T,<T<Y,tX 

where Ti, . . . ,Tm+l^ and T are independent random variables exponentially dis- 
tributed with parameters A^^ , . . . , \i„^^i , and 1, respectively. 

Since the joint distribution of Ti, . . . ,Tm+i,T is equivalent to Lebesgue mea- 
sure and since event R has positive probability, the distribution /i of Ti, . . . , T^, T 
conditioned on R induces a measure on 

A = |(ti,...,t„,i)eM™+i : J2^j<t\ 

^ 3 = 1 ^ 

that is equivalent to Lebesgue measure. The regularity of Fj guaranteed by Theo- 
rem [5] implies that the function /i : A — !> Af defined by 

/ m 

JiV'l 5 • ■ • 1 ^m 1 ^ ) — -^i 1 ^1: • • • : ^rtli ^ / ^ T^j 

^ J = l 

has a nonempty open set of regular points in A, and the proof is completed by an 
application of Lemma [U since Q^^i^ is the pushforward of /i under /j. 

5. Absolute continuity of ergodic invariant measures 

According to the Ergodic Decomposition Theorem, all invariant measures for a 
Markov semigroup can be represented as convex combinations of ergodic ones (see, 
e.g., jHai061 Theorem 5.7]). We will use this to derive Theorem [1] from absolute 
continuity of ergodic invariant distributions. 

To define ergodicity, we need to recall the notion of /i-invariant sets. Let /i 
be an invariant measure for the Markov semigroup (P*). We say that a set A e 
B{M) ® V{S) is /.t-invariant if for every i > 0, Pi^{A) = 1 for /i-almost every 
(^, i) G A. An invariant measure /i is called ergodic if for every /i-invariant set A, 
either fi{A) = 1 or fi{A) = 0. 

The following is a basic result on systems with Markov switchings that does not 
use Conditions A or B. 

Theorem 6. If fi is (P*) -invariant and ergodic then it is either absolutely contin- 
uous or singular. 

Proof: Consider the Lebesgue decomposition fi = fiac+t^e, where Hac is absolutely 
continuous and fi^ is singular with respect to Lebesgue measure. Let us show that 
both fXac and /j,s are invariant. 

For any i > 0, using the invariance of /i, we can write 

k 

(8) tlac+tls =/i = /iP* =/iacP*+A*sP* =X1^J +/^«P*' 

where 

(9) i^j(-)= / PL(-W(d?x{j}), j€S. 

JM 
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We claim that the measures Vj^ j G S, are absolutely continuous. To see this we 
check that for any sequence i = (ii, . . . ,im+i) with ii ^ j, the measure Vi defined 

by 



(10) 



J Al 



R]^Jiac{d^y•{J}) 



is absolutely continuous (here we use the notation introduced in Section[3]) . Suppose 
\^^{E) = 0. For fixed Ti, . . . ,Tm,Tm+i, the map $i is a diffeomorphism in ^. 
Therefore, on event R introduced in (j4]), we have 

/^acKx{j}: $i(^ri,...,r™,i-^r,,n e^j =o, 

and Vi{E) — follows from disintegrating the right side of ([TU]) and changing the 
order of integration. 

Now, using (j8]) and the absolute continuity of Vj, j e 5, we can write 

k 

(11) jJi-ac = y^'^3 + (A*sP*)ac ■ 

Since P|j(M x 5) = 1 for aU ^ and j, © implies Y!1=i "ji^ x 5) = fiac{M x 
5). Therefore, applying ([TT|) to A/ x S, we obtain that the absolutely continuous 
component of the measure /i^P* is zero. In other words, /i^P* is singular, and 
from ^ and the absolute continuity of Vj , j £ S', we obtain 

(12) fis^fisP'. 

In other words, fig is invariant for (P*). It follows from (|8]) that iiac is also invariant. 
Since /x is ergodic, it cannot be represented as a sum of two nontrivial invariant 
measures. This means that either fi = fiac oi fj, = (is- D 

We endow the state space S with the discrete topology and recall that a point 
(f , i) € M X S is contained in the support of a measure if and only if the measure 
of every open neighborhood of (^, i) is positive. 

Theorem 7. Let fj, be an ergodic invariant measure for (P*). Assume that the 
support of fi contains a point {r],i) such that Condition B holds at rj. Then, /i is 
absolutely continuous with respect to Lebesgue measure on M x S . 

We will need several auxiliary statements. 

Lemma 4. Let v be a finite Borel measure on M x S with support K . If U is any 
open set in M x S whose intersection with K is nonempty, we have 

i^iunK) >o. 

Proof: Assume that i'{U D K) — 0. The complement of the support of J-C has 
measure zero. Therefore 

v{u) = v{u r]K) + v{u n K") = 0. 

Thus, U^ is a closed subset of M x S* whose complement has measure zero. From 
the definition of the support, we obtain K C If^. But then, U D K must be empty, 
a contradiction. D 
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Lemma 5. Fix a time t > 0, an open subset E of AI and an index j G S. The set 
H of points {S,,i) (z M x S satisfying Pi ^{E x {j}) > is open. 

Proof: We will use the notation introduced in Section |3l 

Let us assume that H is not open and there is a sequence {{^p,i))peN in H'^ 
converging to a point (^, i) G H. 

Since (^, i) is an element of H, there exists an admissible sequence 
i= {i,i2,...,im,j) for which P^,i(Xt G E\Ci) > 0. 

On the other hand, we have P^^^i{Xt G E\Ci) = for all p G N. Therefore, for 
each p, the set B{^p) has zero Lebesgue measure, where 

B{f]) = |t G At^,„ : <^i(ti,...,t„^,t-J2tj,T]j gsI, -qeM. 

If t G B{^py for all p, then $i(t,^) G E"^ since $i(t,-) is a diffeomorphism 
and E'^ is a closed set. Hence, the Lebesgue measure of B{^) is also zero, so 
P^,i{Xt G E\Ci) = 0, which contradicts our assumption and finishes the proof. D 
Proof of Theorem [7j According to Theorem [6] we need to show that fi is 
not singular. If /u is singular, it is entirely supported on a zero Lebesgue measure 
set G C M X S, so t^iG"^) = 0. Since /x is (P*)-invariant, it is also Q-invariant. 
Therefore, tJ-[G'^) = fiQ{G'^), and we see that ^i{V) = where 

V = {{^,j)eMxS: Q5,,(G^)>0}. 

Let U be the set of points i^ G A/ where Condition B holds. Due to Theorem [31 
U X S CV, and we conclude that ^{U x S) — 0. 

Recall that U is an open subset of M, and {U x S) D supp /i ^ by assumption. 
LemmalHimplies that /i((C/xS')nsupp/i) > 0. The contradiction with fi{UxS) = 
completes the proof. D 

Of course, if one replaces Condition B in Theorem [7] with the stronger Condi- 
tion A the resulting statement holds automatically, but one can give a proof that 
does not involve the resolvent Q: 

Theorem 8. Let fi be an ergodic invariant measure for (P*). Assume that the 
support of fi contains a point {r],i) such that Condition A holds at rj. Then, fi is 
absolutely continuous with respect to the Lebesgue measure on M x S. 

Proof: According to Theorem [6] we need to show that fi is not singular. If ^ is 
singular, it is entirely supported on a zero Lebesgue measure set G C Af x 5, so 
^l{G'') = 0. Since ^l(G'') = mP*(G=), we see that ^l{V) = where 

V^{{tj)eMxS: Pl^{G')>0}. 

Let U be the set of points ^ G M where Condition A holds. Due to Theorem [21 
U X S (ZV, and we conclude that ^{U x S) ~ 0. 

Recall that U is an open subset of M, and (C/ x 5) fl supp /i ^ by assumption. 
Lemma[4]implies that /i((C/x 5) Hsupp^) > 0. The contradiction with fi{UxS) = 
completes the proof. D 

6. Proof of Theorem [1] 

First, we establish two properties of the set E ^ LDU, where U is the open set 
of points satisfying Condition B. 
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Lemma 6. The set E has nonempty interior. 

Proof: By assumption, ^ G £■ , so C/ / and i(^) DU ^ (/} hy continuity of the 
vector fields in D. Since ^ G C/, Theorem [5] implies that L(^) has nonempty interior 
that is dense in -L(^). Therefore, the set 

v = L{^)°nu 

is nonempty and open. Clearly, V C U, and it remains to prove that L{^)° C L. It 
is sufficient to show that W Ci L{ri) ^0 for any nonempty open subset W of L{£_) 
and any rj £ M. 

Let us take any ( G W. Since C is Z?-reachable from f , there exist i and t such 
that 

C = *i(t,0- 

The mapping h defined by h{x) = ^{(t,^),^; G M, is a diffeomorphism on M. 
Therefore, h~^{W) is an open neighborhood of f. Since ^ G E C L{7]), there is 
a point p G h^^{W), D-reachable from rj. Consequently, h{p) £ W is also D- 
reachable from r/. D 

As an immediate corollary of Lemma IHl the set L has nonempty interior. 

Lemma 7. Suppose p, is an invariant measure for (P*). If G is a nonempty open 
subset of L and j G S, then fi{G x {j}) > 0. 

Proof: Let us assume that pi{G x {j}) = 0. Since p, is (P*)-invariant, it is also 
Q-invariant, and we have 

= /i(G X {j}) =Y, f Qri AG X {jJMdv X {*}). 
^^^ Jm 

For alH G 5 and /i(- x {i})-almost every rj G M, we thus obtain 
(13) Q„,,(Gx{j}) = 0. 

Let us choose rj such that (|13p holds true. 

By assumption, we have G d L C L{rj). Since G is open, G fl L{r]) ^ 0. 
So there exist a sequence i = {i,i2, ■ ■ ■ ,im,j) and an interswitching time vec- 
tor t = (ii, . . . ,i„i,i,„+i) such that ^i{t,ri) G G. By continuity of $i there is 
a neighborhood W of t in K™+^ such that $i(s, r/) G G for all s G W^. De- 
noting s = si -I- . . . -|- Sm+i and using the representation of P^.i(-|Gi) via expo- 
nentially distributed times that we used in the proof of Theorem [21 we conclude 
that Pf j(G X {j}) > for s sufficiently close to i = ti + . . . + tm+i- Therefore, 
QvAG X {j}) > contradicting ^. D 

Proof of Theorem [TJ Any invariant measure can be written as a convex 
combination of ergodic invariant measures. Therefore, it suffices to show absolute 
continuity and uniqueness of an ergodic invariant measure. 

Let us begin by deriving absolute continuity. If /x is an ergodic invariant measure 
that satisfies the assumptions of Theorem [T] then, due to Theorem [71 it suffices to 
show that L C supp/i. Let ^ £ L, and let U he a neighborhood of ^ in M, j G S. 
By Lemma[71 we have p{U x {j}) > 0, hence £, G supp/x. 

In order to prove uniqueness of the ergodic invariant measure, let us assume that 
pi and 1^2 are two distinct ergodic invariant probability measures. Birkhoff 's ergodic 
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theorem then implies that /ii and /i2 are mutually singular. Hence, the set M x S 
can be partitioned into two disjoint subsets Hi and H2 with fii(H2) = /i2(^i) = 0. 
The two sets can be represented as 

k 

H„=\jMa.jX{j}, a = 1,2, 

for some measurable sets Maj, j € S, a = 1, 2. For all a and j, 

/i„(M„,j X {j}) = /i„(M X {j}) > 0, 

since the left side is a stationary distribution for the Markov chain on S and by our 
assumptions, transitions between all states happen with positive probability. 

Fix a j in S. By virtue of Lemma [51 the set E° is nonempty. According to 
Lemma [71 for all j € S we have fJ-i{E° x {j}) > 0. Since ^i(M2,j x {j}) — 0, we 
deduce that fj,i{Ei x {j}) > 0, where Ei ^ E° D Mi,-,. 

The measure ^i is (P*)-invariant, hence it is also Q-invariant, and we have 



(14) = ^ll{M2., X {j}) > / Q„,j(M2,, X {j})A/i(d77 X {j}). 

JEi 

Since ^i(£'i x {j}) > 0, it sufBces to show that Q,,j(A/2j x {j}) > for all rj e Ei, 
to obtain a contradiction with P^ . 

Since 77 satisfies Condition B, Theorem [S] guarantees that there exist an integer 
m> n and a vector i = (j, ^2, . . . , i„i, j) such that the function / : R™"*"^ -> M 
defined by 

/(t) = *i(t,r;) 

has an open set O of regular points such that for alH > 0, 

{t = (ii,...,i™+i) eO : ii + ...+t™+i <i}^0. 
Therefore the map F defined by 

F{ti, . . . ,t„i+l,t) — f iti, . . . ,tm,t — /_^ti j 
^ 1=1 ^ 

on 

• m 771+1 N 

A= i(ii,...,i™+i,i)eR'['+2 : ^ti <t<^ti\ 

has an open set V^ C A of regular points such that 

(15) {t = (ti,...,t,„+i,t)el/:t<s}^0, s>0. 

Using the representation of Q via ([B]) and the family of exponentially distributed 
times Ti, . . . , Tm+x-, T ^ we obtain that it is sufficient to prove that 

(16) P{F{Ti, . . . ,T„,+i,T) e Af2,j| R] > 0, 

where R was introduced in ([7|)- 

Since E° is an open set containing 77, and FiV) is an open set such that 77 € -F(l^) 
(due to P^ and continuity of F at 0), we obtain that G = E° D F{V) is also a 
nonempty open set. 

Let us choose a vector r ^ V such that F(r) e E° . Since r is a regular point for 
F, we see that for an arbitrary choice of local smooth coordinates around r, there 
are n independent columns of the matrix DF(s) for s in a small neighborhood of r. 
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Without loss of generality we can assume that these are the first n columns. Then 
the map p : M™+2 -^ M x M™+2-" defined by 

p{si, . . . , Sm+l,s) = {F{si,. . . , Sm+i, s), S„+i, . . . , Sm+l,s) 

has nonzero Jacobian in that neighborhood. So we can choose an open set Wy 
containing r so that p is a diffeomorphism between Wy and Wq x Wn-m-2, where 
Wg C G and Wm+2-n C ]R™+^~" are some open sets. 

The set Wq is an open subset of L. It is also not empty since it contains F{v). 
Lemma [7] implies that /Z2(VFg x {j}) > 0. Since /X2(M|j x {j}) = 0, we conclude 
that iX2{J X {j}) > where J = M2J n Wg- Since /X2 is an ergodic measure, it is 
absolutely continuous, so 

(17) A^(J) > 0. 

Since J C M2J, the desired inequality P^ will follow from 

(18) P{F(Ti,...,r,„+i,r)e j|i?}>o. 

Since the joint distribution of Ti, . . . , T^, Tm+i, T is equivalent to the Lebesgue 
measure on A, Lemma [3] implies that p(Ti, . . . , Tm+i, T) has positive density almost 
everywhere in Wg x Wm+2-n- Integrating over Wm+2-n, we see that 
F{Ti, . . . , Tm+i,T) has positive density almost everywhere in Wg- Now (fT8|) follows 
from dni). D 

Of course, Theorem [1] remains true if one replaces Condition B by the stronger 
Condition A. However, under that condition one can prove this result without 
referring to the resolvent Q. Namely, one can use the regularity of transition prob- 
abilities established in Theorem [2] (which is stronger than the regularity established 
in Theorem [3]), and invoke Theorems [4] and [8] instead of Theorems [5] and [T] 

7. Examples 

In this section, we apply Theorem [T] to two concrete switching systems. In 
the first example, we have a closer look at the system on the n-dimensional torus 
T" = R^/Z" that was introduced in Section [2?3l In the second example, we switch 
between two Lorenz vector fields with different parameter sets. For both systems, 
uniqueness of the invariant measure is derived from Theorem [TJ For the system on 
T", we point out the invariant measure explicitly. 

Let M be the n-dimensional torus T", and let D — {ui, . . . , m„} be the standard 
basis of R". We assume for simplicity that the parameter A of the exponential 
time between any two switches is independent of the current state, and that we 
have a uniform probability of switching between any two states. In Section 12.31 we 
implicitly argued that Condition A does not hold for this system: If Condition A was 
satisfied at some point ^ e T" , the transition probability measures P, ^ would not 
be singular with respect to Lebesgue measure, according to Theorem [21 However, 
as pointed out in Section [2. 3[ the measures Pi ^ are purely singular. 

It is also instructive to show directly why Condition A does not hold. As all the 
vector fields in D are constant, the derived algebra T'{D) contains only the zero 
vector field. Thus, for any ^ e T", 

MDm^\Y,Ku,-- 5]A, = 
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Due to the constraint J27=i ^i — ^i the algebra Xq[D){^) does not have full dimen- 
sion, so Condition A is violated at every point in T". 

On the other hand, Condition B is clearly satisfied at any point ^ G T", as 
the standard basis of M" applied to ^ yields a full-dimensional set of vectors in 
the tangent space. Also note that any point in T" is Z?-reachable from any other 
point. Therefore, Theorem [T] guarantees that the associated Markov semigroup has 
a unique invariant measure, provided that such a measure exists. In this elementary 
example, it is possible to point out the invariant measure explicitly. For Borel sets 
i? C T" and states i g 5, it is given by 

li(E^{i})^--\{E). 
n 

Here, A denotes Lebesgue measure on T". 

The second example provides a situation where (i) the number of vector fields 
in D is less than the dimension of the manifold M, and (ii) each individual vector 
field in D gives rise to dynamics with a strange attractor and no absolutely con- 
tinuous invariant measures, but (iii) the switched system has a unique invariant 
measure and it is absolutely continuous. 

Namely, we consider switching between two Lorenz vector fields with different 
parameter values. A Lorenz vector field is a vector field defined in R'^, of the form 



u{x,y,z) 



where a^ r and b are physical parameters. Let the set D contain exactly two 
Lorenz vector fields ui and W2 such that ui has Rayleigh number r — 28 and U2 
has a Rayleigh number different from, but close to, 28. We assume for both vector 
fields that a = 10 and that b — ^, which is the classical parameter choice for the 
Lorenz system. In |Tuc99) . Tucker shows that the Lorenz system with parameters 
cr = 10, r = 28 and ^ = I, corresponding to vector field ui, admits a robust strange 
attractor A as well as a unique SRB-measure supported on A. Robustness implies 
that the dynamical structure of the system remains intact under small parameter 
changes, so the dynamics induced by U2 share these features if r is sufficiently close 
to 28. Moreover, the SRB-measure on A satisfies a dissipative ergodic theorem, 
see e.g. [BIJ83| Section 5.1]. It follows that any point ^ e A is {wi }-approachable 
(and thus Z)-approachable) from every point in a set S^ C M'^ with zero Lebesgue 
measure complement. 

Assisted by a computer algebra system, we checked that Condition A is satisfied 
for this system at any point in R^ that does not lie on the z-axis. Since the z-axis 
is invariant under the flows of both vector fields, we disregard it and set M to be 
M.^ without points on the z-axis. With this provision, every point on the attractor 
A is D-approachable from any point in M: 

Consider a point ^ G A and a point rj G M. By Theorem 21 there is a nonempty 
open set of Z?-reachable points from r] (recall that Condition A holds at any point 
in M). And since this open set has positive Lebesgue measure, it contains a point 
belonging to 5^. Hence, ^ is D- approachable from rj. As in the first example, 
uniqueness and absolute continuity of an invariant measure follow from Theorem [1] 
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